1 link tagged with all of: meta + real time synthesis + video avatar + ai + muse realtime avatar
Links
Meta released Muse Realtime Avatar, a system that generates expressive video avatars synchronized with AI speech in real time. It achieves 870ms latency while outperforming existing avatar products from Runway and HeyGen in user preference tests.
- The system reduces computational cost by 60x through distillation, condensing a teacher model's 120 diffusion steps into a student model's 2 unguided steps while preserving quality.
- Muse generates 448x768 video at 25 fps with ~870ms end-to-end latency, handling 12 concurrent sessions per GPU through optimized inference, KV cache reuse, and four-bit quantization.
- Head-to-head comparisons with leading commercial avatar systems showed raters preferred Muse Realtime Avatar across visual quality, synchronization, character consistency, and mannerisms.
muse realtime avatar
meta
video avatar
real time synthesis
ai